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Background: In 2003, the Accreditation Council for Graduate Medical Edu- 
cation (ACGME) mandated 80-hour resident duty limits. In 201 1 the ACGME 
mandated 16-hour duty maximums for PGY1 (post graduate year) residents. 
The stated goals were to improve patient safety, resident well-being, and edu- 
cation. A systematic review and meta-analysis were performed to evaluate the 
impact of resident duty hours (RDH) on clinical and educational outcomes in 
surgery. 

Methods: A systematic review (1980-2013) was executed on CINAHL, 
Cochrane Database, Embase, Medline, and Scopus. Quality of articles was 
assessed using the GRADE guidelines. Sixteen-hour shifts and night float 
systems were analyzed separately. Articles that examined mortality data were 
combined in a random-effects meta-analysis to evaluate the impact of RDH 
on patient mortality. 

Results: A total of 135 articles met the inclusion criteria. Among these, 
42% (N = 57) were considered moderate-high quality. There was no overall 
improvement in patient outcomes as a result of RDH; however, some studies 
suggest increased complication rates in high-acuity patients. There was no 
improvement in education related to RDH restrictions, and performance on 
certification examinations has declined in some specialties. Survey studies 
revealed a perception of worsened education and patient safety. There were 
improvements in resident wellness after the 80-hour workweek, but there 
was little improvement or negative effects on wellness after 16-hour duty 
maximums were implemented. 

Conclusions: Recent RDH changes are not consistently associated with im- 
provements in resident well-being, and have negative impacts on patient out- 
comes and performance on certification examinations. Greater flexibility to 
accommodate resident training needs is required. Further erosion of training 
time should be considered with great caution. 
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After the tragic death of a young woman named Libby Zion in a 
New York Hospital, resident duty hour (RDH) restrictions were 
introduced in this state. An investigation ruled that lack of super- 
vision, the resident's lack of familiarity with this woman's complex 
diagnosis and resident fatigue were contributing factors in the tragic 
outcome. In July 2003, the Accreditation Council for Graduate Medi- 
cal Education (ACGME) mandated an 80-hour duty limit on residents, 
averaged over a 4-week period. In 201 1, the ACGME mandated 16- 
hour duty periods for first year residents whereas the province of 
Quebec instituted 16-hour periods for all in-house residents in 2012. 
The stated goals of duty hour limitations were to improve patient 
safety, resident well-being, and education. 1 Surgical disciplines have 
expressed concern with the contraction of duty hours stating that 
the impact on training time could have a negative effect on educa- 
tional and patient outcomes. 2 Specifically, the American College of 
Surgeons, Division of Education, has stated that mastery in surgery 
requires extensive and immersive experiences. 3 A "one-size fits all" 
approach to RDHs may not be appropriate given the variation in 
training needs, diversity of practice patterns, and various competen- 
cies required among disciplines. 4,5 

In March 2012, the Royal College of Physicians and Surgeons 
of Canada undertook a project to develop a pan-Canadian consen- 
sus on issues related to RDH. A national steering committee was 
struck and this committee further created 6 expert working groups. 
Recognizing that surgical training is unique in many aspects and 
that there have been significant obstacles related to the implemen- 
tation of RDH in surgery, a specific working group entitled Special 
Considerations for Procedural and Surgical Disciplines was created. 
The National Steering Committee's full report is published elsewhere 
(www.residentdutyhours.ca). 5 As part of this process, the Procedu- 
ral/Surgical discipline working group performed a systematic review 
and meta-analysis to evaluate the association between RDH and clin- 
ical and educational outcomes in surgery. 

METHODS 

Study Selection 

A systematic review (1980-2013) was executed using indexed 
databases CINAHL, Cochrane Databases, Embase, Medline, and 
Scopus to identify pertinent articles relating to RDH restrictions 
with a focus on identifying articles that addressed the 201 1 ACGME 
regulation and Quebec arbitration. Search terms were developed and 
revised by experts in surgical education. Predetermined eligibility cri- 
teria were used to eliminate articles beyond the scope of this review. 
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Articles were included if the research focus was related to the im- 
pact of RDH restrictions on surgical resident well-being, education, 
and/or patient safety. Articles were also included if they addressed 
heterogeneity across different residency training programs and the 
varying impacts of RDH on different fields of health care. All ab- 
stracts and titles were reviewed by 2 members of the research team 
for inclusion in review (K.D. and I.K.). To ensure the comprehensive 
inclusion of high-quality literature on this topic, additional articles 
identified from hand searching of references and recommendations 
from content experts were added (Fig. 1). 

Data Abstraction and Analysis 

Quantitative and qualitative data extractions were performed 
independently by 2 members of the research team for all studies 



meeting the inclusion criteria. If consensus could not be reached, 
disputes were resolved by a third member of the research team (N A.). 
The quality of the articles was assessed using the GRADE guidelines. 6 
Each article was rated on a 4-point scale from high to very low, 
based on the level of confidence in the effect estimate. Attributions 
for consideration of high quality included multicentre designs, high 
volume of participants (>100), and control groups and that of low 
quality included unvalidated surveys and single institutional studies. 

Extracted data were tabulated and examined for interpretation. 
Articles identified as moderate and high quality were analyzed sepa- 
rately. Articles graded as low or very low quality were not included in 
our overall analysis to maintain the integrity of the results. All articles 
examining 16-hour and night float shifts were analyzed and reported 
separately to determine the effects of more recent changes. Major 



709 ARTICLES 






253 ARTICLES 










121 ARTICLES 



456 ABSTRACTS AND DUPLICATES EXCLUDED 



132 



ARTICLES EXCLUDED 



14 



ADDITIONAL ARTICLES INCLUDED 



135 



ARTICLES 



57 



HIGH -MODERATE 



17 



16-HOUR MAX SHIFT 



NIGHT FLOAT ARTICLES 



Inclusion criteria 

Focuses on duty hours and/or resident 
fatigue/alertness with respect to: 

■ surgery 

■ resident training 
Explores, describes, compares, 
implements, or evaluates duty hours 
and/or resident fatigue/alertness with 
respect to 1 or more of the following 
domains: 

■ resident wel Iness / hea Ith 
promotion 

■ resident education 

patient safety / medical errors 
heterogeneity (regarding training 
and/ or disciplines) 

Publication type is one of the 

following: 

• program evaluation 

■ case study 

■ survey, questionnaire, interviews, 
or focus groups 

systematic review/ meta-analysis 
observational/ cohort study 
randomized controlled trial 
letter or editorial 
AND 

the most recent version of the 
highest quality 



Search terms include: Internship and residency; graduate medical education; societies, medical; 
fellowships and scholarships; pgy, postgraduate year; specialties, surgical; surgery department, 
hospital; personnel staffing and scheduling; workload; duty hours; working time; work schedule; work 
schedule tolerance; ACGME, accreditation council on graduate medicine; medical errors; patient safety; 
health status; health promotion; wellness; professional competence; clinical competence; skill; motor 
skills; outcome assessments; hospital mortality; surgical volume; educational measurement; continuity 
of care; resident; resident education; medical education, surgery; postgraduate education; surgical 
training; restriction 

FIGURE 1. Study selection and inclusion criteria. 
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findings for patient safety, resident well-being, and education were 
divided into actual and perceived impact. The term "unclear" was 
used to categorize studies that reported contradictory results or when 
the abstractors were unable to draw firm conclusions from the article. 

Qualitative analysis was completed using the grounded theory 
approach. Open and axial coding was executed to capture themes 
from articles relevant to the 3 areas identified as sensitive to RDH re- 
strictions: patient safety, resident well-being, and education. Themes 
were tabulated and refined. Qualitative themes are reported to add 
context to the quantitative data. Detailed results of the qualitative 
review will be reported separately. 

Statistical Analysis 

Articles that examined mortality data were combined in a 
random-effects meta-analysis to evaluate the impact of RDH on pa- 
tient outcomes. The analysis was conducted in the statistical program 
R using the metafor package. 7,8 An odds ratio greater than 1 means 
a higher risk of death for Pre-RDH, relative to Post-RDH and odds 
ratio less than 1 means a lower risk of death for Pre-RDH relative 
to Post-RDH. A random-effects model was fit using the restricted 
maximum likelihood estimator. 

RESULTS 

A total of 709 articles were identified from indexed sources 
(CINAHL: 50, Cochrane Databases: 4, Embase: 203, Medline: 301, 
Scopus: 151). After the review of abstracts, full articles, suggested 
papers from content experts, and hand searching of references 135 
articles were identified as eligible for data analysis (Fig. 1). 

Study Characteristics 

Ninety-five percent (128) of the studies were conducted in 
the United States or Canada, with 53% of these being multicentre 



(Table 1). General surgery was the most commonly studied discipline, 
comprising half of all studies. The primary study designs were surveys 
(61, 45%), interventional studies, with the intervention being the 
implementation of RDH restrictions (52, 39%) and observational 
studies (8, 6%). Only 1 article used a randomized controlled trial 
to examine the impact of duty hour restrictions (1%). Overall study 
objectives were to evaluate the impact of duty hour restrictions on 
resident education (101, 75%), patient safety (79, 59%), and resident 
wellness (48, 36%). Nine articles (7%) specifically compared the 
effect of RDH on training in various specialties. Fifty-eight percent 
of articles were graded as low or very low quality (N = 78) and 42% 
of studies were graded as moderate or high quality (N = 57). 

Major findings of articles with respect to the impact of duty 
hour restrictions on patient safety, resident well-being, and education 
can be listed as follows (Table 2). 

Section 1: Effect of RDH Restrictions Including 
2003, 2011 ACGME Restrictions and the European 
Working Time Directive, From 57 Moderate to High 
Quality Studies 

Patient Safety. Thirty-five (61%) articles, graded moderate to 
high quality, examined patient safety; 8 (30%) of these reported wors- 
ened patient safety outcomes (morbidity and mortality) as a result of 
duty hour restrictions. 9 " 16 Five (19%) reported an improvement 17-21 
and 13 (48%) reported no change. 22 " 34 Of the 9 articles evalu- 
ating perceptions of RDH impact on patient safety, 6 (67%) re- 
ported a decrease in quality of care, 35 " 40 and 2 (22%) reported no 
change. 41 ' 42 Thus, the current impact on patient safety is inconclu- 
sive, but perceptions of health care professionals suggest negative 
outcomes. 

Resident Well-being. Of the 57 articles considered moder- 
ate to high quality, 9 (16%) examined resident wellness. Five 



TABLE 1. Characteristics of Articles (N = 1 35) 



Country 




Study design 




United States 


121 (90) 


Survey 


61 (46) 


Canada 


7(5) 


Interventional (>2 groups) 


52 (39) 


Europe 


6(4) 


Observational 


8(6) 


New Zealand 


1(1) 


Systematic review 


6(4) 


Type of center 




Other 


5(4) 


Academic 


86 (64) 


Program evaluation 


2(1) 


Community 


20(15) 


Randomized controlled trial 


1(1) 


Multicentre 


71 (53) 






Surgical subspecialty 




Study objectives 




General surgery 


67 (50) 


Education 


101 (75) 


Orthopedic 


15(11) 


Patient safety 


79 (59) 


Gynecology 


13 (10) 


Wellness 


48 (36) 


Multi-specialty (including surgery) 


12(9) 


Heterogeneity 


9(7) 


All surgical specialties 


12(9) 


Study quality* 




Trauma 


10(7) 


High 


21(15) 


Othert 


10(7) 


Moderate 


36 (27) 


ENT 


8(6) 


Low 


51 (38) 


Pediatrics 


8(6) 


Very low 


27 (20) 


Cardiac 


8(6) 


Type of surgery 




Neurosurgery 


6(4) 


Emergency 


95 (70) 


Vascular 


5(4) 


Elective 


88 (65) 


Thoracic 


5(4) 


Not described 


38 (28) 


Urology 


3(2) 






Plastic 


3(2) 






Not described 


12(9) 







All the values indicate n (%). 

* Graded moderate-high quality as per Balshem et al. 6 

fOther categories include nonsurgical disciplines reported in combination with surgical subspecialties and infrequently reported surgical specialties (ophthalmology, 
transplant, and critical care). 
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TABLE 2. Summary of Effect of RDH Restrictions on Patient Safety and Educational Outcomes for Studies Graded as 
Moderate-High Quality, and for Studies Focusing on 16-Hour Duty Maximum and/or Night Float Systems 
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Patient safety 


0 


0 


0 


0 


1 


50 


1 


50 


2 


Wellness 


1 


100 


0 


0 


0 


0 


0 


0 


1 


Education 


0 


0 


1 


50 


0 


0 


1 


50 


2 


Perception of wellness (survey) 


3 


100 


0 


0 


0 


0 


0 


0 


3 


Perception of education (survey) 


1 


25 


1 


25 


0 


0 


2 


50 


4 


Perception of patient safety (survey) 


1 


33 


2 


67 


0 


0 
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Section 4 — Both 16-h duty maximums and night float systems (N = 24) 




















Patient safety 


0 


0 


0 


0 


2 


67 


1 


33 


3 


Wellness 


1 


33 


0 


0 


2 


67 


0 


0 


3 


Education 


0 


0 


2 


67 


0 


0 


1 


33 


3 


Perception of wellness (survey) 


6 


55 


1 


9 


1 


9 


3 


27 


11 


Perception of education (survey) 


1 


6 


12 


71 


2 


12 


2 


12 


17 


Perception of patient safety (survey) 


1 


6 


12 


75 


2 


13 


1 


6 


16 


*RDH restrictions including 2003, 2008 ACGME guidelines and European working time directive guidelines. Four articles in this review assessed the impact on nonsurgical 



residents and surgical residents, 3 were included in the high quality review, 20 ' 34 ' 43 3 were included in the review of the 16-hour max shift, 34 ' 70 ' 72 and 1 was included in the review 
of the night float system. 43 



f Contradictory results or unable to draw firm conclusions from findings. 
JGraded moderate-high quality as per Balshem et al. (201 1). 6 



(71%) reported that duty hour restrictions had improved resident 



wellness 



and 2 (29%) reported no change, ■ as mea- 



sured by validated tools such as Maslach Burnout Inventory. Of the 
7 articles evaluating perception of wellness, 4 (57%) reported im- 
provement after RDH 24,42,44 and 3 (43%) reported no change. 37,39 ' 45 
Overall, the majority of articles reported improved resident 
wellness. 

Resident Education. Thirty-three (58%) articles graded as 
moderate to high quality examined resident education. Thirteen 
(48%) of these reported that educational outcomes were worsened 
after the implementation of RDH 38,40,46-56 and 1 1 (41%) reported no 
change, 22,24,26,32 ' 45 ' 57-62 using measures such as examination scores 
including American Board of Surgery certification data. Only 1 (4%) 
study showed an improvement in educational outcomes; the bal- 
ance of studies showed worsened or no significant effects of RDH 
restrictions. 44 Of the 1 1 articles evaluating self-reported perceptions 
of RDH impact on education, 4 (36%) reported a decrease in quality 
of the educational environment after RDH 36,38 " 40 and 4 (36%) re- 
ported no change. 35,37,42 ' 61 Only 1 article (9%) reported a perceived 
improvement in education. 43 Therefore, on the basis of objective tools 
of measurement and perceived impacts, findings suggest resident ed- 
ucation has either worsened or remained unchanged after duty hour 
restrictions. 



Section 2: Effect of the 16-Hour Duty Maximums 

on Patient Safety, Resident Well-being and Educational 

Outcomes From 1 7 Articles 

Seventeen studies evaluated the impact of 16-hour duty maxi- 
mums; 1 1 studies were low quality, 6 were moderate to high quality 
(Table 2). 

Patient Safety. Fifteen articles examined the impact of the 
16-hour duty maximum restrictions on patient safety. Two articles 
objectively analyzed the impact (eg, examined morbidity and mor- 
tality rates), 1 study had unclear results 38 and the other reported no 
change. 34 Of the 14 articles that evaluated the residents' perceptions 
of the impact of 16-hour duty maximum on patient safety, 1 1 (79%) 
reported that patient safety has declined, 4 ' 36-38 ' 63-69 2 ( 1 4%) suggested 
there has been no effect, 70 ' 71 and 1 (7%) was inconclusive. 72 Thus, the 
objective impact on patient safety is inconclusive, but the perceived 
impact suggests patient safety has declined. Decreased continuity of 
care and increased number of handovers were themes identified from 
the qualitative review as causes for a decline in patient outcomes after 
duty hour restrictions. 

Resident Wellness, Fatigue, and Burnout. Nine of the 17 ar- 
ticles examined the impact of 16-hour duty hour restrictions on 
resident wellness; 2 articles using validated measures (eg, Maslach 
Burnout Inventory) concluded there has been no significant change. 
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Eight articles examined the perceived impact; 3 (38%) reported 
improvement, 64 ' 70 ' 72 1 (13%) suggested wellness was worse, 67 1 
(13%) reported no significant change, 37 and 3 (38%) had unclear 
results. 4 ' 65 ' 71 Validated tools suggest no significant change after RDH 
restrictions; findings from the perceived impact are unclear. Thematic 
review of the data suggests resident training, professional satisfac- 
tion, preparedness for more senior roles, and the wellness of more 
senior trainees has been compromised by the practice of 16-hour duty 
maximums. 71 

Resident Education. Fifteen articles evaluated impact of the 
16-hour duty maximums on resident education; 2 objectively as- 
sessed the impact and concluded education was worse (eg, exam- 
ination data and/or clinical performance). 38 ' 55 Fourteen examined 
the perceived impact; 12 (86%) articles concluded that education is 
worse 4 ' 36 ' 38,64 " 72 and 2 (14%) reported no significant change. 22 ' 35,37 
Overall, both the objective and perceived impact findings support a 
trend toward worsened outcomes. Thematic data analysis of the lit- 
erature suggests 16-hour duty maximums result in poorer integration 
into teams and mentoring of residents, increased patient handover, 
decreased operative exposure, and increased self-reported medical 



Section 3: Effect of Night Float Systems From 8 Studies 

Our analysis of the 8 studies examining night float systems 
showed that there was an improvement in resident wellness reported 
in 1 study, 43 there were 2 studies that reported adverse or unclear 
effects on resident education, 38,43 and 2 studies reported negative 
impacts on patient safety (Table 2). 29,38 No studies of night float 
systems showed improved patient or resident educational outcomes 
using objective criteria. Survey data suggested improved resident 
wellness (N = 3 studies). 43 ' 73 ' 74 Two studies reported a perception 
of worsening patient outcomes 38 ' 73 with an inconclusive effect on 
resident education. 43 ' 73 



Section 4: Effect of 16-Hour Duty Maximums and Night 
Float Systems From 24 Studies 

When considering the 24 articles examining both 16-hour duty 
maximums and night float systems, we found that 3 studies ex- 
amined the effect of these call models on morbidity and mortality 
(Table 2). 29 ' 34,38 No studies showed an improvement or a worsening 
effect on patient safety as a result of these changes to RDH. Con- 
cerning resident wellness, 1 of 3 studies reported an improvement, 43 
whereas 2 studies reported no change in resident well-being. 34 37 
With respect to resident education, there were no studies showing 
improvement. Two studies showed worsened educational outcomes 
using examination data, access to operating room (OR) times, and 
clinical performance; 38 55 in 1 study, the overall impact could not 
be determined. 43 In more than half of the studies (6, 55%) using 
self-reported survey data, residents believed that their wellness had 
improved after 16-hour shift restrictions and/or the implementation 
of night float systems. 43,64,70 ' 72-74 Seventeen surveys queried self- 
reported educational outcomes and 12 (71%) surveys showed that ed- 
ucational outcomes were believed to have worsened; 4,36 ' 38 ' 64 " 72 only 
1 (6%) survey reported improved educational outcomes. 73 Sixteen 
survey studies examined the effects of 16-hour or night float sys- 
tems on perceptions of patient safety; 12 (75%) reported a perception 
of worsened patient outcomes, 4,35-38 ' 64-69 ' 73 whereas 1 (6%) survey 
reported improved perceptions of patient safety. 74 

Figure 2 summarizes the findings from the 17 papers related 
to 16-hour duty maximums; 13 studies were surveys. The results of 
studies related to resident wellness and fatigue are heterogeneous with 
a few studies in each category. Six studies examined time in the OR 
and overall reported that there was decreased time in the OR (N = 5) 
as a result of RDH restrictions. 4 ' 35 ' 37,55,68 Fifteen studies examined the 
effect on patient safety and found a strong signal toward worsened pa- 
tient outcomes (N = i 0), 4 ' 35-37 ' 64-69 with no study reporting improved 
patient outcomes. Fifteen studies examined education and training; 1 2 




■ Improved 
u Worsened 
u No change 

■ Unclear 



Wellness (N=9) Fatigue (N=ll) Time in OR (N=6) Patient Safety Education and 

(N=15) Training (N=15) 

Wellness analyses included: 12689 residents (surgical and non-surgical), 38 surgical trainees (residents 
and fellows), and 549 program directors. 

Fatigue analyses included: 3848 residents (surgical and non-surgical), 50 program directors, program 
coordinators and residents, and 1013 program directors. 

Time in the operating room analyses included: 1620 surgical residents and 954 program directors. 

Patient safety analyses included: 13375 residents (surgical and non-surgical), 1418 program directors, 
38 surgical trainees (residents and fellows), 50 program directors, program coordinators and residents. 

Education and training analyses included: 11301 residents (surgical and non-surgical), 1418 program 
FIGURE 2. Impact of 16-hour duty directors, 38 surgical trainees (residents and fellows), 50 program directors, program coordinators and 
maximums in surgery (N = 1 7 studies), residents. 
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FIGURE 3. Forest plot describing the effect of RDH restrictions 
on patient mortality. 



of these showed worsened outcomes 4 ' 36 ' 38 ' 55 ' 65 " 68 ' 70 " 72 and 3 studies 
showed no significant change. 35 ' 37 ' 69 No studies reported improved 
educational outcomes. 

Section 5: Effect of RDH Restrictions on Patient 
Mortality and Morbidity 

Mortality. A Forest plot summarizing 13 studies examining 
the effect of RDH on patient mortality is presented in Figure 3. 
Two population-based series demonstrate an increase in patient 
mortality. 18 ' 19 Overall, the Random Effects model suggests a trend 
toward increased mortality in surgical patients in the epoch of time af- 
ter the implementation of RDH restrictions, compared with the epoch 
of time before the implementation of RDH restrictions. However, this 
effect did not reach statistical significance. 

Morbidity. Fifteen studies examined the effect of RDH restric- 
tions on postoperative morbidity and are summarized in Table 3. 
Because of the heterogeneity of the manner in which complications 
reported, we were unable to conduct a meta-analysis related to these 
outcomes. Overall, there were 1 5 studies from which we could extract 
data; 6 studies reported increased patient-level morbidity as a result 
of RDH. 10 " 14 ' 21 The systematic review conducted by Jamal et al 25 
reported no overall change, but their results suggested an increase in 
complications in patients undergoing emergency surgery. Two sys- 
tematic reviews had heterogeneous results and did not report a con- 
clusive impact of RDH restrictions on surgical patient morbidity. 17 ' 20 
Two studies reported decreased complication rates, 15 ' 19 and 3 studies 
reported no significant change in patient complications as a result 
of RDH restrictions. 5 ' 22 ' 29 Privette et al showed decreased rates for 
major complications after RDH restrictions but increased rates for 
minor complications, and no significant change for total and moder- 
ate complications after RDH restrictions. 18 More recent studies and 
those studies examining acutely ill patients reported increased com- 
plication rates post duty hour regulations. 10 ~ 13 ' 21 

DISCUSSION 

We have completed a comprehensive review of the relevant 
literature related to RDH restrictions in surgery. This study has several 
limitations. These limitations are related to the heterogeneous nature 
of the studies, the various RDH restrictions imposed over varying time 
intervals, the clinical contexts in which they were conducted, and that 
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for the vast majority of studies, randomization was not possible owing 
to the regulated nature of duty hours in most jurisdictions. In addition, 
although there are many areas of debate with respect to the impact of 
duty hour restrictions, this article focused on patient safety, resident 
wellness, and resident education. Unfortunately, other topics such 
as professionalism, impact on surgical faculty and costs associated 
with mitigating the impact of RDH restrictions was deemed outside 
the scope of this review. The large number of articles examining 
perceptions of RDH impact using unvalidated surveys reduces the 
validity of the findings; to mitigate this, the perceived impacts were 
reported separately. Most of these papers were categorized as low 
quality and therefore not included in our final results. Finally, it proved 
impossible to conduct a meaningful meta-analysis of the literature 
related to surgical complications because of the manner in which 
these data were collected and reported across studies. The authors 
instead chose to report their findings in tabular format. 

Patient Safety 

One of the stated goals of RDH restrictions was to protect 
patients from the deleterious effects of physician fatigue. Although 
evidence demonstrating deficits in attention and hand-eye coordi- 
nation after sleep deprivation suggest that physician fatigue could 
compromise patient safety, particularly for the surgical population, 
this contention has not been demonstrated to date. 16 ' 22 ' 25 " 27 ' 33 ' 75 " 79 
Careful review of the literature over the last decade fails to demon- 
strate improved patient safety after the implementation of RDH 
restrictions. A recently published, high-level meta-analysis survey- 
ing the surgical literatures shows convincingly that there has been 
no improvement in patient safety as a result of RDH restrictions. 25 
Our study confirmed that overall there was no reduction in mortal- 
ity in the RDH epoch (Fig. 2). More recently, there is increasingly 
strong evidence that RDH restrictions could be associated with harm 
to patients. 11 ' 75 Recent, larger studies demonstrated increased mor- 
bidity and mortality, specifically in high-acuity patient populations 
as a result of restrictions in RDH. 10 " 12 Specifically, studies in neu- 
rosurgery, cardiac surgery, and critical care show that patient-level 
complications have increased after the implementation of restricted 
RDH. 10,11 ' 13 The largest study suggesting that RDH restrictions have 
increased patient morbidity was performed by Poulose et al. 16 An in- 
terrupted time series analysis was performed between 1995 and 2001. 
Approximately 2.6 million patient discharges from New York area 
hospitals were reviewed annually over that time period. The authors 
demonstrated increased incidence of thrombotic/embolic complica- 
tions and accidental lacerations and punctures after the institution of 
RDH restrictions. In 2012, Hoh et al 11 analyzed the Nationwide In- 
patient Sample database of more than 107,000 neurotrauma patients. 
They compared teaching hospital versus nonteaching hospitals for a 
3-year period before and after the 2003 ACGME Work Duty Hours 
restrictions. The complication rates did not change in nonteaching 
hospitals (OR = 0.98; 95% CI: 0.787-1.22; P = 0.86) but did change 
significantly in teaching hospitals (OR = 1.23; 95% CI: 1.00-1.50; 
P < 0.05). There were no differences in mortality rates between 
the hospitals across these time points. The increased complications 
were attributed to the increased handovers. The notion that increas- 
ing the frequency of handovers has negative impacts on patient safety 
has been substantiated by a number of other studies. 63 ' 76 ' 80 A re- 
cent study published by Dumont et al in the Journal of Neurosurgery 
also suggested an increase in complications. The authors studied a 
prospectively collected divisional Morbidity and Mortality database. 
They showed that the morbidity rate increased from 70 to 89 per 1000 
patients treated after institution of work-hour restrictions (P — 0.001). 
The morbidities that were deemed avoidable or possibly preventable 
increased from 56 to 66 per 1000 patients treated (P — 0.0 17). 10 
These same authors queried the Nationwide Inpatient Sample for all 
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patients admitted for elective craniotomy for meningioma from 1998 
to 2008, excluding 2003. The complication rate was compared for 
5-year epochs at teaching and nonteaching hospitals before (1998- 
2002) and after (2004-2008) the ACGME work hour restrictions. 
They identified 21,177 patients who met the inclusion criteria. They 
found a statistically significant increase in complication rates from 
14% to 16% in teaching hospitals in contrast to a stable 15% compli- 
cation rate in nonteaching hospitals. This effect remained significant 
in a multivariate analysis including age and existing comorbidities. 
Aligned with previous research related to the 2003 ACGME regula- 
tions, there is no demonstrable improvement in patient safety after 
the 2011 ACGME 16-hour duty limitations. More recent evidence 
studying the effect of 201 1 ACGME regulations suggests a decrease 
in patient safety related to increased numbers of handovers and work 
compression. 34 Similar results of increased complications as a result 
of RDH restrictions have been documented in a large series of inten- 
sive care unit (ICU) patients. 81 Surgical diseases, complication, and 
outcomes may differ qualitatively from other fields of medicine, as 
surgical practice is tied to large inpatient units with patients whose 
clinical course can evolve significantly over hours. The observed 
worsening of outcomes in surgery as a result of RDH restrictions may 
be related to an increased frequency of handovers, which cause frag- 
mented care and loss of crucial information. Frequent shift changes, 
as experienced with some restrictive RDH stipulations, may impede 
residents' ability to observe the natural course of disease and rec- 
ognize deviations from an expected trajectory and complications of 
surgery. It is imperative that surgeons are trained to recognize the 
early signs of postoperative problems and institute appropriate inter- 
ventions. The development of surgical acumen and the management 
of complications of surgery require repeated exposures so that subtle 
variations in clinical presentations can be mastered. 

Resident Wellness, Fatigue, and Burnout 

Review of the literature pertaining to the change in RDH re- 
strictions in surgery shows an improvement in resident well-being, 
fatigue, and burnout after the implementation of the 80-hour work- 
week and coincident with the 2003 ACGME regulations. However, 
the anticipated improvements in resident wellness, physical or occu- 
pational health, have not been consistently realized from subsequent 
regulations, such as the 2011 ACGME stipulations of 16-hour in- 
house duty maximums for first-year residents. A longitudinal cohort 
study undertaken by Sen et al 34 showed that the decrease of working 
hours under the 201 1 ACGME standards have resulted in an "unan- 
ticipated increase in self-reported medical errors" and has not shown 
an improvement in well-being or depressive symptoms, nor has it 
prompted an increase in hours of sleep. Drolet et al in a large na- 
tional survey of residents from all specialties showed that 48% of 
respondents disapprove of 1 6-hour call maximums and only 22% of 
respondents supported the move to 16-hour duty in-house call max- 
imums. The restrictions were perceived as detrimental to resident 
quality of life, education, and engagement with their supervisor. The 
residents' survey responses suggest an improved quality of life for 
interns; however, quality of life for senior residents seems to suffer in 
the new paradigm. Interns also reported a decreased sense of readiness 
for more senior roles, raising a concern that 20 1 1 duty hour reforms 
could result in prolongation of an already lengthy training. 71 ,12 Antiel 
and colleagues conducted a longitudinal survey of US PGY1 (post 
graduate year) surgery residents training under the 1 6-hour duty max- 
imum regulations. Participants reported a significant negative effect 
on quality of life in their first year of training, a lack of continuity 
of care, exposure to supervisors and operative cases. 37 A prospec- 
tive longitudinal cohort multicentre study of 2323 PGY1 trainees 
(58% response rate) showed that although there was a small decrease 
in duty hours worked per week, there was no significant change in 
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hours slept, depressive symptoms, or well-being (measured using a 
validated tool). 34 A smaller, single-center study showed that surgical 
residents experienced a paradoxical increased sense of fatigue and felt 
that their education was compromised as a result of 1 6-hour duty max- 
imums. In addition to residents reporting feeling more fatigued, they 
also reported that they could not master surgical skills and perceived 
a decline in the quality of patient care they provided. Seventy percent 
of residents reported feeling disconnected from their service and that 
their mentoring relationship with faculty was compromised. Sixteen 
hour in house call maximums resulted in increased rates of burnout, 
isolation, as well as reduced morale among surgical trainees. 67 

Night, evening, rotating, and irregular shifts may also be as- 
sociated with an elevated risk of workplace injuries and elevated 
rates of burnout. Shift work in general is associated with increased 
preterm labor, depression, weight gain, increased rates of injury and 
burnout and has been classified as a class I carcinogen by the World 
Health Organization. 82 Studies show increased rates of needle stick 
injury among surgical residents training under traditional 24-hour call 
models. 83 However, the incidence of needle stick injuries is correlated 
with the level of the learner more so than with sleep deprivation. 84 
These findings suggest that implementation of early education could 
decrease this specific occupational risk. Continuous wakefulness for 
prolonged periods (24 hours) should be avoided, especially if this 
pattern is frequently repeated. The period of duty for residents may 
not necessarily have to equate with continuous wakefulness. Rest 
periods and protected sleep time that respects circadian physiology 
could improve resident fatigue and professional satisfaction, whereas 
preserving their access to educational opportunities and preserving 
patient safety. Night float systems alternate at weekly intervals as 
per the ACGME guidelines, causing not only a disruption in one's 
internal balance but creating a cycle where a resident may not have 
sufficient time to recover from the disruption before being exposed 
again to a 12-hour shift. Residents who adhere to traditional 24-hours 
call schedules may be more likely overall to experience relatively 
normal sleep patterns with deep sleep occurring at night. Thus far, 
it seems the recent trend toward night float and shift work has not 
yielded the desired result of more rested and professionally satisfied 
surgical residents. 

Education and Training 

Overall, of the 15 studies examining the effect of 16-hour 
duty maximums, none showed improvements in educational outcomes 
after the implementation of RDH restrictions. The majority of studies 
showed worsening of outcomes, whereas a few studies showed no 
change. Studies related to RDH restriction in education showed that 
overall the total numbers of operations performed during residency 
have decreased slightly. However, there has been a proportionately 
greater decrease in the volume of emergency surgical procedures 
performed. Furthermore, the residents' role in the OR has changed 
over the last decade, with a significant decline in the numbers of 
cases reported as first assistant and as teaching assistant. 51 This trend 
is worrisome, as first assistant cases represent an opportunity for 
trainees to learn surgical anatomy, steps of the procedure and receive 
mentorship in the OR, and the teaching assistant role allows residents 
to develop and demonstrate surgical mastery. 51 These findings are 
consistent with recent studies related to resident time in the OR after 
the implementation of the 1 6-hour duty maximums, with 5 of 6 studies 
demonstrating decreased time in the OR; no studies demonstrated a 
neutral effect or increased time in the OR. Most recently, in a study 
of 249 surgical residents, Schwartz et al 55 showed a 25% decrease 
in PGY1 -level operative cases subsequent to the implementation of 
16-hour duty maximums, compared to the 4 previous years. 

The mastery of procedural components of surgery requires 
time on task in a mentored environment and with graduated respon- 
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sibility. Specifically, achieving mastery of complex technical tasks 
requires deliberate practice. Some authors suggest that 10,000 hours 
of deliberate practice may be required. 85 ' 86 Teaching of technical 
expertise and surgical judgement requires that mentors spend lon- 
gitudinal time with trainees to appreciate their strengths and weak- 
nesses. Coaching in the OR specifically requires that mentors observe 
progress, provide feedback, and then look for progress at the next op- 
portunity. In teaching programs, surgical faculty voice a growing 
concern that they have insufficient exposure to individual residents 
to identify deficiencies, address weaknesses, or provide meaningful 
evaluation. This observation is especially true for night-float rotations 
where exposure to teaching faculty can be extremely variable, ran- 
dom, and often brief. 87 This phenomenon may delay the maturation of 
surgical competence in the OR and result in prolongation of training. 
This unintended consequences of shift work and night float systems 
was described in a nationwide survey of US PGY1 residents as they 
are feeling less prepared to assume the PGY2 role. 71 

Simulation has emerged as an important adjunct to training for 
specific types of skills. It can prepare learners for laparoscopic, en- 
doscopic, and endovascular procedures through use of geometric ex- 
ercises, which can accustom them to the 2 dimensional environment, 
thus improving hand eye coordination and instrument handling. Well- 
designed simulation curricula for these types of procedures result in 
greater ease with routine parts of the operation and can decrease time 
to achieve competence and entry into practice. 88 Simulation training 
also has an emerging role in teaching crisis resource management 
skills, such as leadership and communication; 89 however, its impact 
on patient outcomes remains unknown. Simulation for open surgery is 
useful to assist residents to learn the repetitive parts of operations (eg, 
practicing a stapled bowel anastomosis using porcine material). These 
motor skills then become more "automatic," allowing learners to fo- 
cus on anatomy, pathology, and judgment when they are in the OR. 
However, relying on simulation to learn clinical reasoning, intraoper- 
ative decision-making, or refining sophisticated surgical techniques, 
especially for open surgery, is not feasible. Simulation models lack 
fidelity to human anatomy and tissues and are ill equipped to accom- 
modate for variation, unexpected findings, and abnormal or diseased 
anatomy. Simulation training is best thought of as preparatory for 
residents' participation in the OR, as skills beyond the fundamental 
level in open surgery and accommodation to the 2 dimensional en- 
vironment for laparoscopic procedures are better learned in the OR 
under the guidance and coaching of an experienced mentor. 

Perhaps most concerning is the trend toward increased failure 
rates on the oral component of the various surgical board examina- 
tions. Although correlation does not imply causation, as many factors 
are involved in the outcome of board examinations, the American 
Board of Thoracic Surgery reported that over the last decade there 
has been a nearly linear increase in the failure rate of candidates, with 
35% of trainees being unsuccessful in 2012, compared with 12% 
in 2003. 53 In General Surgery, the American Board failure rate has 
nearly doubled from 15% to 25% over 10 years, with a peak failure 
rate of 28% in 201 1-20 12. 52 Interestingly, the results on written ex- 
amination have remained static. Whereas performance on the written 
examination reflects knowledge and synthesis of information, perfor- 
mance on the oral examination tests judgement and candidates' real 
world experience with complex surgical issues. The American Board 
of Neurologic Surgeons has increased the length of residency train- 
ing from 6 to 7 years, suggesting that ongoing RDH restrictions may 
affect the duration of training and time to achieve competence for 
independent practice. A survey conducted by the Fellowship Coun- 
cil of 145 subspecialty General Surgery program directors showed 
that they found starting fellows to be inadequately prepared for the 
OR; 38% demonstrated a lack of patient ownership, 30% could not 
independently perform a laparoscopic cholecystectomy, 66% were 
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deemed unable to operate for 30 minutes unsupervised on a major 
procedure, and one-quarter were unable to recognize the early signs 
of complications. 90 

Trainees' involvement in emergency operations is important 
for the development of surgical judgement and competence. Resi- 
dents learn from their integral involvement in patient care about the 
evolution of surgical diagnoses; when to operate, how much diagnos- 
tic accuracy is sufficient, and perhaps most importantly, to recognize 
and manage surgical complications. Major surgical complications 
are relatively infrequent, but they are serious. Rare presentations and 
infrequent complications of surgery require greater flexibility in res- 
ident scheduling, so that residents may benefit from these exposures, 
as expertise in these areas remains tied to experiences nested in the 
clinical environment. These aspects of surgical acumen are an es- 
sential part of professional maturation and require time on task. As 
emphasized in a recent commentary in the New England Journal of 
Medicine by Kesselheim et al. education and service are inextricably 
linked and the current focus on "duty hours" as an isolated con- 
sideration may undermine the overarching objective of postgraduate 
medical training. 77 Our findings as well as others', emphasize that 
surgery perhaps more than other disciplines, requires immersion in 
the clinical environment, and that to a significant degree the training 
of a surgeon is well suited to the apprenticeship model. 

2011 ACGME Restrictions— 16-Hour Duty Shift 
Maximums for Surgical Residents 

Review of the 17 studies that focused on assessing the im- 
pact of the 16-hour duty maximums showed a trend toward an over- 
all negative impact in surgical training. Fargen et al 65 showed in 
a survey of neurosurgical residents across the United States and 
Puerto Rico that 83% of respondents disagreed with, or strongly dis- 
agreed with 1 6-hour duty maximums for PGY 1 residents. De Martino 
et al 64 reported a similar concern among vascular surgery trainees. 
Recently, a national survey of 549 US program directors from In- 
ternal Medicine, Pediatrics and General Surgery programs revealed 
that 72% did not approve the 16-hour shift limit for interns. Al- 
though they generally did agree with other ACGME duty hour re- 
strictions, they felt that currently, there were simply too many re- 
strictions and that these restrictions resulted in negative effects on 
resident education, preparedness for senior roles, and no tangible 
benefits to resident wellness. 70 These authors support greater flexi- 
bility with program and specialty specific tailoring of the educational 
environment for trainees. Our findings, and those of other authors, 
do not support 16-hour duty maximums for surgical residents at this 
time. Implementation of these RDH restrictions should be antici- 
pated to result in prolongation of an already lengthy training duration 
and potential risk to patients, without tangible benefits to resident 
wellness. 

Solutions to Improve Resident Wellness 

Streamlining Resident Workflow and Investment 
in Wellness Resources 

Residency systems have created expectations in teaching cen- 
ters that the "doctor (aka resident) is always around." This phe- 
nomenon dates back to the origins of the term "Resident." Perhaps 
it is time to step back and reconsider the current role and purpose 
of surgical residency. Residents are present in teaching hospitals to 
learn about and deliver patient care. Their time and energy should be 
preserved to participate in patient evaluations, decision making, and 
operating. Surgical training needs to be more efficient. Other mem- 
bers of the health care team, such as physician assistants, nurse prac- 
titioners, respiratory therapists, pharmacists, phlebotomists, physio- 
therapists, and social workers, if correctly deployed could alleviate 

1050 | www.annalsofsurgery.com 



some of the "nonphysician" functions that currently distract resi- 
dents from focusing their time in OR, management of ill patients, 
ambulatory clinics, academic rounds, and structured curricula. 11 ' 91 
This approach would improve residents' professional satisfaction and 
sense of wellness. Additional strategies to alleviate fatigue and pre- 
vent burnout include improved opportunities for sleep while on call 
as was recommended in the 2009 Institute of Medicine report. These 
solutions more readily respect circadian physiology than the cur- 
rent trend toward shift work and night float systems. 92 ' 93 Improved 
handover tools, innovations such as electronic rounding reports, and 
polices to escalate care to more senior residents and faculty, when 
appropriate, would alleviate resident workload and improve patient 
safety. 94 

Expansion of OR resources and acute care surgery teams may 
be necessary in certain settings to better ensure urgent operative cases 
are completed during daytime hours when feasible, leaving overnight 
OR resources for patients who present during the evening and night 
with life, limb, or vision threatening surgical diagnoses. 95 ' 96 There 
will remain a subset of patients who require urgent operative in- 
tervention after midnight. Resident participation in these patients' 
preoperative and operative care is essential for residents' profession- 
alization. 

Expansion of Wellness Resources and Implementation 
of Wellness Programs 

Physicians, and perhaps to a greater extent surgeons, have long 
ignored our own health. This phenomenon in part is related to our 
professionalization and societal expectations, but it is also connected 
to the reality that every single one of our patients at any given mo- 
ment is much worse off than the treating doctor. For the resident on 
a ward of cancer, trauma, sepsis, or burn patients, prioritizing one's 
own health is nearly impossible. Structural changes are required to 
accommodate this reality and enable residents to attend to their own 
physical and emotional well-being when necessary. One of the key 
recommendations in the Royal College of Physicians and Surgeons 
of Canada National Steering Committee report is to move the cur- 
rent discussion away from one that is focused solely on RDH and 
includes institutional strategies that enable fatigue mitigation and 
management, rather than relying only on externally imposed RDH 
limits. 5 This strategy, in part, could include wellness programs within 
residency structures that screen for and are equipped to manage psy- 
chological distress and burnout. Wellness programs are defined by 
a combination of active and passive initiatives targeting the various 
domains of physical, mental, social, and intellectual wellness and 
have been shown to be effective, inexpensive, and well received by 
trainees. 97 " 99 

CONCLUSIONS 

Systematic review of the literature related to RDH restrictions 
in surgery shows that there were benefits to resident wellness real- 
ized from 2003 ACGME regulations limiting RDH to 80 hours per 
week. However, there seems to be some concern for increased mor- 
bidity and mortality rates in high-acuity patients as a result of the 
2003 and to a greater extent the 2011 ACGME regulations. 11 ' 12 ' 20 
Also concerning is the trend for poorer performance on American 
Board of Surgery certification examinations over the last decade. 
Further evaluation of the literature related specifically to the imple- 
mentation of 16-hour duty maximums for PGY1 residents in the 
United States and all in-house residents in the province of Quebec 
showed that there may be little added benefit to residents' wellness. 67 
Recent evidence suggests that adverse patient outcomes may ex- 
tend beyond the highest acuity patients in surgery, as residents 
perceive increased rates of medical errors as a result of 16-hour 
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duty maximums. Equally concerning, we found no evidence for 
improved educational or training experiences as a result of 16-hour 
duty maximums. Rather, there seems to be consistent findings across 
many studies of increased patient handovers, poorer team integra- 
tion, professional dissatisfaction, concern for maturation of clini- 
cal skills, and decreased time in the OR. Philibert et al 100 recently 
published a literature review of high-quality articles with similar 
conclusions. 

Fatigue is potentially harmful, mitigating its effects while en- 
suring adequate training is essential. Strategies such as less than 24 
hour shifts have failed to demonstrate a significant benefit to res- 
ident wellness and potentially deleterious consequences for patient 
and training outcomes. 35 ' 38 ' 55 This observation has also been docu- 
mented in critically ill patients in the ICU setting. 81 Training should 
prepare residents for schedules commonly encountered in the inde- 
pendent practice of that specialty. It is clear that a "one-size fits all" 
solution to the issue of RDH restrictions is not appropriate for all 
medical disciplines. A more tailored and discipline specific approach 
is required such that training objectives and patient outcomes are 
protected. This view has been supported by a pan-Canadian consen- 
sus process related to RDHs, led by the Royal College of Physicians 
and Surgeons in Canada. 5 This report is the first nonsurgical docu- 
ment to support this perspective, one that has been emphasized by 
many surgical education bodies including the American College of 
Surgeons, Division of Education and the Royal College of Surgeons 
of Edinburgh. 3 ' 101 The challenge for surgical training programs will 
be how best to support resident wellness though fatigue mitigation 
strategies, screening and addressing resident burnout, as well as im- 
proving resident workflow to optimize resident sleep, supervision 
and minimize tasks unrelated to the provision of medically necessary 
care, and preserving access to key mentorship and high impact learn- 
ing opportunities. An approach that centers on the training mandate 
of residencies and allows a degree of flexibility will be necessary if 
we wish to preserve robust educational and patient-level outcomes 
without further prolonging an already arduous and lengthy training 
experience. It is well time to reconsider the direction of RDH as it 
relates to surgical training, as the recent erosion of resident training 
time has not achieved the desired results. A broader dialogue be- 
yond duty hours alone will yield a more satisfactory outcome for all 
stakeholders, and especially for surgical residents. 
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